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TWO TIME SCALE OUTPUT FEEDBACK 
REGULATION FOR ILL-CONDITIONED SYSTEMS 

* t 

Anthony J. Calise and Daniel D. Moerder 
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SUMMARY 

Issues pertaining to the well-posedness of a two time scale approach 
:o the output feedback regulator design problem are examined. An 
ipproximate quadratic performance index which reflects a two time scale 
decomposition of the system dynamics is developed. It is shown that, 
under mild assumptions, minimization of this cost leads to feedback gains 
providing a second-order approximation of optimal full system 
performance. A simplified approach to two time scale feedback design is 
also developed, in which gains are separately calculated to stabilize the 
slow and fast sybsystem models. By exploiting the notion of combined 
control and observation spillover suppression, conditions are derived 
assuring that these gains will stabilize the full-order system. 

A sequential numerical algorithm is described which obtains output 
feedback gains minimizing a broad class of performance indices, including 
the standard LQ case. It is shown that the algorithm converges to a 
local minimum under nonrestrictive assumptions. This procedure is 
adopted to and demonstrated for the two time scale design formulations. 
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SECTION 1 


INTRODUCTION 

This report examines the continuous time optimal output feedback 
regulator problem for linear, time-invariant, deterministic systems with 
ill-conditioned dynamics. In the sequel, an output feedback controller 
will be characterized as one in which the feedback law is based on a set 
of system outputs, rather than the full internal state. In the 
time-invariant regulator case, the simplest form of the controller is 
that of a matrix of constant gains. This is referred to as static gain 
output feedback. The extension of output feedback to the case of 
fixed-order dynamic compensation is also considered, where an arbitrary 
number of dynamic elements are included in the feedback structure. 

Output feedback control laws offer the important advantage of 
simplicity in implementation over controllers which are based on 
full-state feedback. Since the control designer only rarely has access 
to all of the system states, implementing a full-state feedback 
controller requires an observer or Kalman filter in order to reconstruct 
the states unavailable directly from the output. In contrast, the 
structure of an output feedback controller can be kept as simple as is 
consistent with the constraint of output feedback stabilizability , or 
that of meeting closed-loop design criteria. This has motivated the 
study of LQ optimal output feedback regulation problems [1-7].' In these 
problems, given the prespecified feedback structure, the controller gains 
are calculated to minimize an infinite-time integral quadratic perfor- 
mance index on the state and control. This formulation is particularly 



advantageous in that it directly addresses the issue of RMS control 
activity, allowing the designer to make a well-defined compromise 
between a measure of the system performance and one of the control 
expenditure required to attain it. 

The necessary conditions for optimality [1] for the optimal output 
feedback problem take the form of coupled nonlinear matrix equations. 

For realistic problems, solutions are obtained numerically through the 
use of iterative procedures. This fact lies at the root of the two major 
difficulties which have impeded the application of optimal output 
feedback design techniques to practical design problems: 

i. ) the lack of simple, computationally inexpensive, convergent 

numerical algorithms for solution of the necessary conditions, 

ii. ) the fact that realistically detailed system models 

tend to be of large order, and often contain slow and fast 
modes. This leads to ill-conditioning in computations related 
to controller design. 

1.1 Numerical Procedures for Optimal Gain Calculation 

Many algorithms have been suggested for numerically solving the 
necessary conditions for optimality, falling into one of two broad 
categories. The first category comprises gradient [8-10] and nongradient 
based search procedures [11,12]. These algorithms will converge to a 
stationary point [8], but are computationally expensive. The second 
category of algorithms consist of those in which either the nonlinear 
necessary conditions [1] or a related system of linear equations [3,4,13] 
are solved sequentially. When they do converge to a solution, these 
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methods are recognized as being considerably faster than the search 
procedures [12]. Of this latter class of algorithms, only that of [13] 
for the discrete LQ stochastic output feedback regulator has been shown 
to converge. 

Section 2 of this report formulates the continuous time LQ output 
feedback regulator problem. A simple sequential algorithm is described 
which calculates optimal output feedback gains for a broad class of 
problems which includes the standard LQ case. Unrestrictive conditions 
are stated under which this algorithm provides a monotonically improving 
sequence of gains converging to a stationary point. 

1.2 Output Feedback Design for Systems with Ill-Conditioned Dynamics 

Even given the practical and reliable algorithm in Section 2, 
numerical calculation of optimal gains for system design models which 
include slow and fast modes can be difficult or impossible due to the 
numerical ill-conditioning of such models. In addition, the sensitivity 
of numerical procedures to ill-conditioning increases with the 
dimensionality of the system model. 

These considerations have motivated the use of singular perturbation 
theory (SPT) [14] for decomposing ill-conditioned linear systems into 
well-conditioned slow and fast subsystems. Loosely speaking, the 
singularly perturbed approximation of a system with asymptotically fast 
dynamics consists of approximating the fast modes as infinitely fast. 
Under this assumption, fast transients decay instantaneously, so that the 
fast states are replaced by an algebraic function of the slow states. 
Similarly, if one wishes a well-conditioned approximate model for the 
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fast dynamics, one approximates the slow states as being infinitely slow, 
compared with the fast. The slow states are then replaced by constant 
values at some boundary condition near which the fast behavior is of 
interest. We thus obtain two subsystems, each approximating a portion of 
the original model. This is also referred to as a "two time scale" 
approximation. It should be noted that this theory has been extended to 
systems where the fast dynamics are marginally stable [15]. For the 
problem considered here, however, interest centers on the case of 
closed-loop asymptotic stability. 

The singularly perturbed LQ full-state feedback regulator problem 
has attracted considerable attention [16-21], Here, an SPT decomposition 
of the system dynamics leads to a complete separation of the regulator 
design into slow and fast subproblems. This very convenient feature does 
not exist in the case of singularly perturbed output feedback systems, 
occuring naturally only for a highly restrictive class of output 
structures [22,23]. In full-state feedback, each subsystem is stabilized 
through a dedicated gain matrix feeding back only the subsystem states. 

In output feedback, the slow and fast subsystems must both share a single 
gain matrix based on the system output. This requires that, in general, 
the dynamics of both subsystems must be accomodated simultaneously in the 
design. In fact, designing an output feedback controller based only on a 
low frequency "design model" may destabilize neglected fast states [24]. 

Section 3 provides a detailed development of the SPT decomposition 
of a closed— loop system with output feedback, and addresses various 
issues relating to the well-posedness of the design problem and of the 
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approximation. Section 4 describes the SPT approximation of the optimal 
output feedback problem and states a design procedure. Gains designed by 
this method provide a second order approximation to closed-loop integral 
quadratic performance. Unfortunately, the form of the necessary 
conditions for optimality dictate that systems of equations be solved for 
the dynamics of both subsystems simultaneously. 

The complication of simultaneously designing for the slow and fast 
subsystems can be circumvented when the input/output structures of the 
slow and fast subsystems exhibit rank deficiency. This situation is not 
as restrictive as it may sound. Subsystem I/O rank deficiency can occur 
even when none exists in the full-order system, since both lower order 
subsystems have the same number of inputs and outputs as the full system. 
In fact, the phenomenon is commonplace in models of systems which have 
many sensors and actuators. When this is the case, the use of combined 
control and observation spillover suppression can be employed in 
separating the subsystem control designs into separate tasks. This is 
examined in Section 5, and a two-step LQ design procedure is developed. 
The spillover suppression constraints are enforced through the use of 
penalty functions, so the theory can also be applied in situations where 
subsystem I/O matrices are only "nearly rank deficient." 

Section 6 briefly examines treatment of two time scale design of 
fixed-order dynamic compensators as an extension of the static gain case. 
A number of questions are raised which, hopefully, will help to motivate 
further work in this area. 

The work is summarized in Section 7. 
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SECTION 2 


OPTIMAL OUTPUT FEEDBACK DESIGN 

In this section, the optimal output feedback problem is formulated for 
a class of problems which includes the standard LQ case. A convergent 
sequential numerical algorithm for solving the necessary conditions for 
optimality is described. Because the algorithm provides a sequence of 
monotonically improving gains, the solution obtained at convergence is 
locally optimal. 

2.1 Problem Formulation and Necessary Conditions for Optimality 


We consider systems of the form 

x = Ax + Bu x(0) = x 0 (2.1) 

where x e n and u e ra , with output 

y - Cx (2.2) 

where ye P. The control has the form 

u = -Gy (2.3) 

The gain G is to be chosen to minimize 

J = /qX T Qx + uTru dt + y(G) (2.4) 


where Q = r”r such that the pair (r,A) is detectable, and R > 0. In 
addition, it will be seen that, in order to avoid singularity in the 
necessary conditions for optimization problem, we must have 

p(C) = p (2.5) 

In (2.4), y(G) is any scalar function having a continuous gradient in G, 
and for which J is bounded below, for all G which render the closed loop 
dynamics (2. 1-2.3) asymptotically stable. This class of performance 
index will find use in Section 5, when it is used to enforce conditions 


6 



leading to a two-stage two time scale output feedback design procedure. 
Also, in section 2.3 we illustrate how a performance index of the form 
(2.4) allows individual gain elements in an output feedback gain matrix 
to be zeroed. Many other applications doubtless exist. 

It is well known that the integral portion of J satisfies the 
relation 

/qX^Qx + u^Ru dt =* tr{Kx 0 x 0 ^} (2.6) 

where K > 0 is the unique solution of 

S(G,K) - A t K + KA + Q + C t G t RGC =0 (2.7) 

A =* A - BGC (2.8) 


and A is asymptotically stable. As suggested in [1], it is customary to 
relieve (2.6) of its dependence on Xq by assuming that it is uniformly 
distributed on the unit sphere; then the problem statement is modified 
slightly to that of minimizing E{J}. This amounts to replacing XoX 0 T in 
(2.6) by I. 

The minimization of (2.4) is now cast, as in [5], as a static 
optimization problem, in which the Lagrangian 

(G,K,L) = tr{K} + y(G) + tr{S(G,K)L T } (2.9) 

is minimized with respect to G, K and L, where L is a matrix of Lagrange 
multipliers. If the system (2. 1-2.3) can be stabilized by output 
feedback, the first order necessary conditions for optimality are 


35? 

3G * 


=■ 0 




( 2 . 10 ) 


where the *'s mean that the gradients are evaluated at the optimal values 
of G, K and L. In the sequel, the * notation is suppressed since the 
gradients are assumed evaluated at their optimal values unless specified 
otherwise. Defining the gradient of y(G) 



( 2 . 11 ) 




the expansion of (2.10) is 


RGCLC t - bTkLC t + «|y g (G) 3 0 

(2.12) 

AL + LA T + I = 0 

(2.13) 

S(G,K) » 0 

(2.14) 

From (2.12), the optimal value of G will satisfy 
G* = r _1 [b t klc t - yg( g )Kclc t ) _1 

(2.15) 


where (CLC T )“1 exists because of (2.5) and the fact that L > 0 in (2.13). 


2.2 A Convergent Numerical Algorithm 

The following algorithm suggests itself for solving (2.12-2.14): 

A 

0. Choose any G such that A is Hurwitz. Set i = 0. 

1. Solve (2.13,2.14) for and L^. 

2. On the basis of (2.15), evaluate 

AGi = R-ltB^KiLiCT - iy G (Gi) ] (CLiC 1 ) -1 - G* (2.16) 

3. Set 

®i+l = Gj + ctAGi (2.17) 

where a e (0,1] is chosen to ensure that 
Ji +1 < Ji ■ tr{Kj} + y(Gi) (2.18) 

4. Set i « i + 1 and go to 1. 

This is a very simple procedure to implement, since it only involves the 
solution of two Lyapunov equations. The unfortunate necessity of 
supplying an initial stabilizing gain for step 0 is shared by other 
sequential algorithms currently available. In [25], a simple procedure 
for obtaining an initial stabilizing gain is given. 

In Appendix B, the following theorem is proven: 
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Theorem 2.1: For the optimal output feedback problem defined in 


(2. 1-2.4), let the following conditions be satisfied: 


i) 

# = £g : A is Hurwitzj ^ 0 


ii) 

p{C} = p 


iii) 

Q = r T r such that (r,A) is detectable; 

R > 0 

iv) 

y(G) is# 1 for all G e # 


v) 

If y(G) ->• -<» for all HG e#H then 

it does so in such a 


way that |y(G)|/tr{K} < 1 

If (i-v) are true, then the sequence i = 0,1,... j of 

stabilizing gains defined by (17) exists for any G 0 e#, such that 
(2.18) is satisfied at each iteration. Moreover, the sequence 
converges to a stationary point in J. 

Note that (i-iii) are the standard conditions required for solving 
the LQ optimal output feedback problem. Loosely speaking, (v) means 
that, in choosing y(G) , one must be certain that it does not become 
negatively unbounded at a faster rate than tr{K) becomes positively 
unbounded for IGII -► ». Recall that, because of (iv), y(G) cannot assume 
unbounded values for finite G. It should also be noted that, while the 
theorem does not rule out the theoretical possibility of convergence to a 
saddle point in J, encountering a saddle in practice would only slow the 
convergence to a local minimum of J, since the saddle point would be 
unstable in G. 

2.3 Numerical Example 

This example illustrates the breadth of the class of problems which 
can be solved using this algorithm. A legitimate criticism of modern 
control theory is that multivariable techniques stress feeding back all 
of the outputs to all of the inputs. Often, this is needless and costly 
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from an engineering standpoint. Recently, in the context of the eigen- 
structure assignment problems [26-29] , and in the context of constrained 
optimization theory [30], attention has been paid to zeroing selected 
elements of the multivariable gain matrix. This feature provides a 
considerable measure of real-world practicality, insofar as it permits 
the designer to balance the dynamic performance of the system against the 
structural complexity of the controller. 

In the context of our theory, the i j t* 1 element of of G is zeroed by 
defining 


y(G)=^g? j (2.19) 

where v > 0 is sufficiently large to result in suppression of the gain 
element. The gradient of (2.19) is 

Yg(G) — ( a qrSqr) (2.20) 

a qr = 5qi (2.21) 
This penalty function was applied to the problem of designing a 
constrained output feedback regulator for the lateral dynamics of an 
L-1011 aircraft at cruise flight condition, taken from [29]. The state 
vector is 


S r 


<$a 

♦ 


P 

6 

x 7 


rudder deflection (rad) 
aileron deflection (rad) 
bank angle (rad) 
yaw rate (rad/ sec) 
roll rate (rad/sec) 
sideslip angle (rad) 
washout filter state 
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The system matrices are 


A = 


-20 

0 

0 

-0.744 

0.337 

0.02 

0 


0 

-25 

0 

-0.032 

- 1.12 

0 

0 


0 

0 

0 

0 

0 

0.0386 

0 


0 

0 

0 

-0.154 

0.249 

-0.996 

0.5 


BT 


0 

0 

0 

0 


20 

0 

0 

0 

0 

0 


0 0 

25 0 

0 
0 
0 
1 


0 

0 


1 

0 

0 

0 


0 

1 

0 

0 


0 0 
0 0 

0 
0 
1 
0 


The system Inputs and outputs are: 


6r c 

6a c 

r wo 

* 

0 

* 


rudder command (rad) 
aileron command (rad) 
washed out yaw rate 
roll rate 
sideslip angle 
bank angle 


The eigenvalues of the A matrix are: 


0 

0 

1 

-0.0042 

- 1.0 

-0.000295 

0 

0 
0 


-1 

0 

0 

0 


*i 

- -20.0 

rudder mode 

*2 

= -25.0 

aileron mode 

*3,4 

= -0.0884 ± j 1.272 

dutch roll mode 

*5 

= -1.085 

roll subsidence 


0 

0 

0 

1.54 

-5.2 

-0.117 

0 


0 

0 

0 

0 

0 

0 

-0.5 



*6 

= -0.00911 

spiral mode 

*7 

= -0.5 

washout filter mode 


For the penalty matrices, 


Q = diag[l 1 30 30 5 5 1] R - diag [1 1] 


the optimal output feedback gain is 

-2.60 -.396 2.72 -.053 

-.998 -2.41 4.36 -3.74 

resulting in the closed-loop eigenvalues 


*1 

= -18.0 


rudder mode 

*2 

- -22.0 


aileron mode 

*3,4 

O 

CM 

• 

f-H 

1 

n 

± j 1.42 

dutch roll mode 

*5,6 

= -1.81 

± j .734 

roll mode 

*7 

= -.746 


washout filter mode 


which closely approximate the values in [29]. Now, optimality aside, due 
to the near-decoupling of yaw-related (6r,r,0) and roll-related ( 6a , ip, <{>) 
states, there is not much to be gained in performance by feeding r and 
6 to S ac , or p and <j> to <5r c . The gain elements corresponding to these 
feedback loops - the (1,2), (1,4), (2,1) and (2,3) positions of G - were 
suppressed by employing (2.19). This structure corresponds to F(4) in 
[29]. In this case 

y(G) = j( gi2 + gl4 + §21 + §23^ 

I 0 §12 0 §14 

Yg( g ) = v 

§21 0 §23 0 

The variation of integral quadratic performance with v is shown in 
Figure 1. For v = 1000, the optimal suppressed gain matrix is: 

-2.78 -.001 3.26 -.004 

-.0009 -4.70 .003 -5.87 
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INTEGRAL QUADRATIC PERFORMANCE 



FIGURE 1. INCREASE IN INTEGRAL QUADRATIC PERFORMANCE FOR 
INCREASING VALUES OF \>. 
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resulting in the closed-loop eigenvalues: 

Xl = -17.7 rudder mode 

X2 = -17.7 aileron mode 

13^4 ■ -1.19 ± j 1.38 dutch roll mode 

X5 =* -1.37 roll mode 

Xg ■ -6.95 roll mode 

X7 ■ -.687 washout filter mode 

Note the actuator and the washout filter modes are close to their 
open-loop values. This illustrates one major advantage in output feed- 
back, in that it does not speed up actuator modes, which is a problem 
commonly encountered in full state feedback. The dutch roll mode is 
relatively unaffected by gain suppression. The roll mode is overdamped 
by gain suppression; however, the roll response is dominated by X5, 
which results in approximately the same settling time as the complex 
modes Xs^g without gain suppression. Thus, the impulse responses of both 
closed-loop systems are essentially the same. The minor degradation in 
the integral quadratic cost (7%) indicates that this is accomplished with 
little increase in control effort. Simply zeroing (1,2), (1,4), (2,1) 
and (2,3) elements in G* has little effect on the closed-loop 
eigenvalues; however, the integral quadratic performance is 157, which 
corresponds to a 17.4% increase. 

From this example it can be seen that this approach to design 
permits total control over the feedback structure while optimizing the 
individual gains for an integral quadratic cost. Insofar as this proce- 
dure is simple to implement, it represents a significant step forward in 
the flexibility and applicability of optimal output feedback design. 


14 



SECTION 3 


SPT IN OUTPUT FEEDBACK 

In this section SPT is employed to decompose an ill-conditioned 
closed-loop output feedback system into its slow and fast subsystems. 

In the process of doing so, we gain some insight into the well-posedness 
of the SPT-approximate design problem. 

3.1 Problem Formulation 


Consider the system 


*1 “ A ll x l + a 12 x 2 + B l u x l(0) = xio 

xi e R ni 

(3.1) 

£X 2 = a 21 x 1 + a 22 x 2 + b 2 u x 2(°) = x 20 

x 2 e R n2 

(3.2) 

where 0 < e « 1, with output 



y = Cjxi + C 2 X 2 

yeRP 

(3.3) 

The feedback law is 



u = -Gy 

u e R m 

(3.4) 

If A 22 is invertible, a reduced order approximation of (3. 1-3.3) 

can be 

obtained by setting e =* 0 in (3.2): 



. 

1 “ Ao + B o u 

5eR ni 

(3.5) 

y =■ c 0 c + d 0 u 


(3.6) 


where 

Ao - Ml “ A 12 A 22 A 21 b o “ B 1 “ a 12 a 22 b 2 

C 0 - Ci - C2A22 a 21 d o = “C2 a 22 b 2 (3.7) 

Substituting (3.4) in (3. 1,3. 2) and setting e = 0, the reduced feedback 
control is expressed as 

u = -G°C 0 5 (3.8) 

Go = (1+ GD 0 ) -1 G (3.9) 
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which necessitates the assumption 
p(I + GD 0 ) =■ m 


(3.10) 


The inverse of (9) is 

G = G°( I - DqG 0 )" 1 (3.11) 

The following lemma states that satisfaction of the invertibility 
conditions for (3.9) and (3.11) is simultaneous, and that this guarantees 
local one-to-one correspondence between G° and G. The proof is given in 
Appendix C. 

Lemma 3.1 : 

p(l - D 0 G°) - p iff P (I + GD 0 ) = m; 

furthermore, these conditions are necessary and sufficient for G° 
and G to be locally one-to-one. 

The next lemma, also proven in Appendix C, assures that (3.10) will hold 
for any G not rendering the fast closed-loop subsystem singular. 

Lemma 3.2 : Given that A 22 is nonsingular, 

p(l + GD 0 ) = m iff p(A22 “ B 2 GC 2 ) = n2 
In summary, Lemmas 3.1 and 3.2 assure that the inverses in 
(3.9,3.11) exist for any realistic design problem. Indeed, if 
A 22 “ B 2 GC 2 were singular, the fast subsystem dynamics would not be 
"fast”. It should be noted that if (3.9) and (3.11) did not define a 
unique correspondence between G° and G, reduced order approximations 
would have very little utility in output feedback design. 

3.2 Asymptotic Properties 

The closed-loop system matrix for (3. 1-3.4) takes the form 
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- An - B 1 GC 1 
A = 

(A 2 i - B 2 GCi)/e 


A12 “ B^GC 2 

(A 22 - B 2 GC 2 )/e 


(3.12) 


Following [31], construct an Invertible transformation which block 
diagonalizes A: 


l 

n 


n 


T(e) 


X 1 

x 2 


(3. 13. a) 



I-eHN 

-eH 


I 

eH 

T(e) = 

N 

I 

T-l(e) = 

-N 

I-eNH 


(3. 13.b) 

In (3.13), 5 is exclusively the slowly varying portion of the closed loop 
state and n is the fast transient. After some algebra, it can be shown 
that 


N(e) = A 2 J(A 2 i - B 2 G°C 0 ) 

+ e(l+A 22 B 2 G°C 2 )A 22 (A 2 i-B 2 G 0 C 0 )(A 0 -B 0 G°C 0 ) + 0(e 2 ) (3.14) 

H(e) = (A i2 - B 0 G°C 2 )A 22 + 0(e) (3.15) 

These expressions can easily be verified from [31], if one recalls the 

definitions in (3.7) and uses the fact that, if A 22 exists, 

(A 22 - B 2 GC 2 ) _1 =» (I + A 22 B 2 G°C 2 )A 22 (3.16) 

Expression (3.16) is obtained by a straightforward application of (A. 5). 

Using (3.13) in (3.12), the dynamics are decoupled: 

5 = [(Ao-B o G°C o )+0(e)U 5(0) - x 10 (3.17) 

et) ■ [(A 22 -B 2 GC 2 )+0(e)]ri n(0) = x 2 o-A 22 (A 2 i-B 2 G°C 0 )xio+0(e) (3.18) 
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so that, for e sufficiently small, 

C(t) = exp[ (A q - B o G°C o )tU(0) + 0(e) (3.19) 

n(t) = exp((A 22 “ B2GC2)t/e]ri(0) + 0(e) (3.20) 

Employing T"l(e) from (3.13) to transform back to xj , X 2 , we obtain 

xi(t) = 5(t) + 0(e) (3.21) 

x 2 (t) = -A22<A 2 i - B 2 G°C 0 ) g( t) + n(t) + 0(e) (3.22) 

Similarly, T"l(e) transforms u as defined by (3. 3, 3. 4): 

u(t) = -G°C 0 5(t) - GC 2 n(t) + 0(e) (3.23) 

This development is summarized in the following theorem: 


Theorem 3.1 : If A 22 “ B 2 GC 2 is Hurwitzian, then (3.21-3.23) 

describe the full order system and control trajectories for all 
finite t > 0. Additionally, if Aq - B 0 G°C 0 is Hurwitzian, then 
(3.21-3.23) are true for all t > 0. 

An Immediate (and crucial) consequence of this theorem is that, for 
sufficiently small e, output feedback stabilizability of the full system 
(3. 1-3.4) is equivalent to joint output feedback stabilizability of both 
subsystems. Note that the output feedback problem does not naturally 
decompose into separate slow and fast designs, as in [18]; instead, G° 
and G must stabilize the separate systems (3.17,3.18) while satisfying 
the hard constraint (3.9). 
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SECTION 4 


NEAR-OPTIMAL OUTPUT FEEDBACK REGULATION 
In this section, for the ill-conditioned system dynamics of Section 3, 
the block diagonalizing transformation T(e) from (3.13) is applied to the 
quadratic performance criterion of Section 2. If the slow subsystem 
measurements are nonredundant, then minimizing the transformed criterion at e 
= 0 results in a gain solution which yields a second order approximation to 
optimal full system performance, while eliminating the dimensionality and 
ill-conditioning difficulties of minimizing directly for the full system 
dynamics. 

4.1 Definition of the Approximate Problem 

The performance index for the full order system (3. 1-3.4) is 

X 

J = Jo^ x l’ x 2^ Q Xg + uTrU dt (4-D 


where R > 0 and Q = r^r such that (r,A) is detectable. Q is compatibly 
partitioned as 


L q 2 q 3 j 

Assuming that the closed-loop system matrix A in (3.12) is asymptotically 
stable, than (4.2) is equivalent to 

J = tr{Kx Q xJ} (4.3) 

where xj is [xIq.x^q], and K > 0 is the unique solution of 


A K + KA + Q = 0 
,T' 


K = 


K x eK^ 


l gK 2 eK 3J 


(4.4) 

(4.5) 
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Ql + CiG t RGCi Q 2 + CiG t RGC 2 

Q 2 + C 2 G t RGCj Q 3 + C 2 G t RGC 2 


The problem of minimizing (4.3) with respect to G can be decomposed by 
using T"l(e) from (3.13) to transform the coordinates from xj,x 2 to £ and 
n. After transformation, (4.4) decouples into: 


Si(G 0 ,K!,e) = aJk x + KjAq + Qi = 0 

(4.7) 

a 22 k 2 + k 2 a 0 + q 2 = 0 

(4.8) 

83(0, K3, e) = A 22 K3 + K3A 22 + Q3 = 0 

(4.9) 

A 0 = Aq - B 0 G°C 0 + 0(e) 

(4.10) 

a 22 = a 22 " B 2 GC 2 + 0( e) 

(4.11) 

T 

Ql - Ql - N t Q 2 - Q 2 N + N t Q 3 N + CoG°RG°C 0 + 0( e) 

(4.12) 

Q 2 = Q 2 - Q3N + C 2 G t RG 0 C o + 0(e) 

(4.13) 

Q 3 = Q 3 + C 2 G t RGC 2 + 0(e) 

(4.14) 


As suggested in [1], it is customary to remove the dependence of 
(4.3) on initial conditions by assuming that they are uniformly distribu- 
ted on the unit sphere. The problem statement is then modified slightly 
to that of minimizing E{J), which amounts to replacing x 0 x 0 in (4.3) by 

the identity matrix. For the two time scale problem, we instead assume 
that [£^(0) ,n^(0) ] is uniformly distributed on the unit sphere. This is 
because, under transformation by T(e) at e = 0, the former assumption 
leads to 


E{ f 5(0)1 U T (0)n T (0)l) 

_T|(0)_ 


= T(0)E{x o xJt t (0) 

I N t 

N I + NNT 


(4.15) 
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which is inconveniently complicated. It should be noted from (4. 3, 4. 5) 
and (3.13) that the difference between the costs resulting from either 
assumption is only 0(e); further, the results from this section can be 
extended to any assumption on the initial condition. 

The transformed cost for this problem is 

J = tr{Ki> + etr{K 3 } (4.16) 

Now, note that the fast subsystem performance measure is, not unexpected- 
ly, 0(e). At e * 0, where we would like to approximate the system dyna- 
mics, there is no cost associated with fast dynamics. On the other hand, 
minimization of tr{Ki(e =0)} with respect to G° must be done over the 

set of gains which would also stabilize A 22 » subject to (3.11). In order 

/ 

to do this in an orderly way, we instead minimize 

jo =■ triKjU = 0)} + e°tr{K 3 ( e = 0)} (4.17) 

where e° is fixed as the value of e in (3.2). In fact, minimizing (4.17) 
allows simultaneous near-optimization of the slow and fast dynamics for 
essentially the same level of computational effort that would have been 
required to minimize tr{Kj(e =0)} alone, subject to the asymptotic sta- 
bility of the fast subsystem. This situation differs with 
that seen in the singularly perturbed state feedback optimization problem 
[18]. There, because of the complete decoupling - of the slow and fast 
subsystems, the control designer has the option of only calculating gains 
for the slow dynamics, if the fast dynamics are open-loop stable and If 
an 0(e) approximation to optimal system performance is satisfactory. 

Even if the fast dynamics require stabilization, this is done as a task 
totally divorced from the slow subsystem design, and without using 
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information about e. Here, in the output feedback problem, the 
constraint (3.9) inseparably links the slow and fast subprobleras. 

It is fairly obvious that a gain G minimizing J°, when applied to 
the full-order dynamics (3. 1-3. 4), will provide an 0(e) approximation to 
actual optimal performance. In cases where p{0 o } * p, however, it is 
possible to make a stronger statement about the near-optimality of the 
approximate gain: 

Theorem 4.1 : Given that p{C) * p, assume that p{C 0 } = p. Let G* 
be such that J(G*) < J(G) for J given by (4.16) and the dynamics 
(3. 1-3. 4). Let G be such that J°(G) < J°(G) for J° given by (4.17) 
and the dynamics (3.17,3.18) at e = 0. Then, 

J(G) = J(G*) + 0(e 2 ) (4.18) 

Theorem 4.1 is proven in Appendix D. 

4.2 Itoo Time Scale Necessary Conditions 

Following [5], minimization of J° is recast as minimization of the 
Lagrangian 

J 0 + tr (S 1 (G°,K 1 ,0)Lj} + tr{S 3 (G,K 3 ,0)L 3 } + tr{S G (G,G 0 )LQ> (4.19) 
with respect to G, G°, Kj, K 3 , Lj, L 3 and Lq at e = 0. In (4.19), Lj, L 3 
and Lq are matrices of Lagrange multipliers, and 

S g (G,G°) - G° - G + GD 0 G° « 0 (4.20) 

from (3.9). Since the rest of the development takes place at e = 0, all 
notation relating to e will be suppressed for simplicity. The necessary 
conditions for optimality are determined by employing trace gradient 
identities found in [5] : 

9i? T t— T 1 

— = RGC 2 L 3 C 2 - B 2 K 3 L 3 C 2 - ^Lq(I - D 0 G°) T = o (4.21) 
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(4. 22. a) 


^ = R 0 G°C 0 L 1 Cq - [BqKj - C ]LiCj + ~(I + GD 0 ) T L G = 0 


R© = R + B 2 A 22 Q3 a 22 b 2 

(4.22.b) 

T —1^ —1 

C = B 2 A 22 (Q2 “ Q3 A 22 A 2l) 

(4.22.c) 

a cp * 

- — = AqU + LiAq + 1 = 0 

(4.23) 

Q? A A 

= A 22l*3 + ^3 a 22 + e °^ “ 0 

3K 3 

(4.24) 

|j£ = S^GO, Kx, 0) = 0 

(4.25) 

= S 3 (G, k 3 , 0) = 0 

(4.26) 

fg - S<;(G, G°) = 0 

(4.27) 

As was mentioned in Section 2, singularity in 

the necessary 

conditions is avoided if one makes the assumption 


p{C} = p 

(4.28) 

Although this by no means assures that C Q and C 2 individually have full 

rank, note that 


p{[C 0 |C 2 ] } = p{CT(0) } | = p 

G° = 0 

(4.29) 


so that the full rank of the total system output is preserved under the 
block diagonalizing transformation of Section 3. This fact is exploited 
in the following subsection, which presents an adaptation of the numeri- 
cal algorithm of Section 2.2 to the computation of near-optimal output 
feedback gains. 

4.3 Computational Algorithm 

The following algorithm can be used to calculate gains satisfying 
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the necessary conditions (4.21-4.27). This is a direct adaptation of the 


algorithm of Section 2.2 and shares its convergence properties. 

0. Choose any G such that A22 “ B2GC2 is Hurwitzian and Aq - B 0 G°C 0 
is Hurwitz subject to (3.9). Set i = 0. 

1. Solve (4.23-4.26) for L*, L3 , kJ, K 3 

2. If i is even, solve (4.22) and (4.21) for 

Lq = 2(1 + G*D 0 )-1 T [bJki + C - R 0 (G°)^C 0 ]LiCo (4.30) 

AG 1 - R _1 [B2K3L3C2 +^(1 - D 0 (G°) 1 ) t ](C2L3C2) + - G 1 (4.31) 
If i is odd, solve (4.21) and (4.22) for 

Lq - 2[B2K3 - RG^lL^cJd - D 0 (G°) i )“ lT (4.32) 

(AG°)i = R^ 1 [(bJkJ+ ? )LicJ - i(I+G i D 0 )TLj](C 0 LicJ) + - (G°)i (4.33) 

3. If i is even, set 

G i+1 = g 1 + oAG 1 , (G°) i+ 1 * (I + G 1+1 D 0 ]“ 1 G 1+1 (4.34) 

or, if i is odd, set 


( G °)i+1 = (G°)i + ^AG 0 ) 1 , G* +1 = (Go) i+1 [l-D 0 (G°) 1+1 ]- 1 (4.35) 
where a e (0,1] is chosen to ensure that 

J i+1 < J? - tr {Kj } + e°tr{K3) (4.36) 

4. Set i = i + 1 and go to 1. 

The only functional difference between this algorithm and that in Section 
2.2 is that, because of the potential for subsystem rank deficiency, 
columns of the transposed gain matrix which fall into im{C2) are 
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incrementally optimized on even iterations, and those which fall into 
im{C 0 } are incrementally optimized on odd iterations. Assuming that C 
has full rank, the optimization at convergence will extend over the 
entire p-diraensional range of C. If C 0 has full rank, then the algorithm 
simplifies to using (4.23,4.33) and (4.35) at each iteration with 
(C 0 LiC 0 )+ replaced by (CqL^Cq) 

4.4 Numerical Example 

In [18], a system of the form (3. 1-3.3) was examined, where 


An = 


0 

0 


.400 

0 


a 12 = 


0 

.345 


0 

0 


Bl - 



a 21 


Cl 


0 -.524 

0 0 


a 22 = 


-.465 

0 



0 

1 


1 

0 


0 

0 


C2 » 


0 0 
1 0 


For the output feedback control structure (3.4), optimal and near-optimal 
gains (minimizing (4.16) and (4.17), respectively) were calculated for 
Q = diag[0.5, 0, 0.5, 0] R ■ 0.5 
at several values of e. For J given by (4.16), the difference 
J(G*) - J(G) is displayed as a function of e in Figure 2. It can be seen 
that the error in performance optimality due to the approximate gain is, 
indeed, 0(e^), as stated in Theorem 4.1. 
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FIGURE 2. LOSS OF OPTIMALITY FOR NEAR-OPTIMAL GAIN AS A FUNCTION OF e . 




SECTION 5 


GAIN SPILLOVER SUPPRESSION IN TWO TIME SCALE DESIGN 
Though the LQ design procedure described in the last Section 
provides a second-order approximation to optimal closed-loop performance, 
it does so at some expense in complexity. This is primarily a result of 
the necessity of solving systems of equations for both subsystems at 
once. In this Section the design problem is decomposed into two separate 
subproblems through exploiting rank deficiency in the slow and fast 
subsystem input and output matrices. This is done by enforcing the two- 
way control and observation spillover suppression constraints. For 
brevity, this will be referred to as gain spillover suppression (GSS). 

The GSS constraints are enforced in an LQ-based design procedure by means 
of penalty functions adjoined to standard integral quadratic cost 
functions based on £ and n. 

The primary emphasis in this Section is on procedural simplicity; 
therefore our attention is focussed on stabilization of the slow and fast 
subsystems rather than designing toward a performance measure based on 
the full-order system. In other words, we design to satisfy the 
following goals: 

(A 0 - B 0 G°C 0 ) is Hurwitz (5.1) 

(A 22 ~ B 2 GC 2 ) is Hurwitz (5.2) 

subject to (3.9). From Theorem 3.1, we are assured that a gain design 
satisfying (5. 1,5. 2) will stabilize the full-order system (3. 1-3.4) for 
sufficiently small e and that, in fact, the closed-loop spectrum of the 
full-order system will be 

o = at (A 0 - B 0 G°C 0 ) + 0(e) ] t )a[(A 2 2 - B 2 GC 2 ) + 0(e)]/e (5.3) 
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5.1 Spillover Suppression Conditions 

Here, conditions are given for using GSS to separate the 
design of G into a two step process: One gain matrix, Gi, is designed 

so as to satisfy (5.1) without disturbing the eigenstructure in (5.2). 

The other, G2, is designed to satisfy (5.2) without affecting (5.1). The 
implemented gain takes the form 

G = G X + G 2 (5.4) 

It will be shown that this particular ordering of the design steps is 
necessary, and that it does not impose any additional restriction on the 
implemented gain. 

Suppose that A 22 is "sufficiently” stable. In this case, let 
G 2 « 0, so that G = Gj in (5.4). In order to avoid gain spillover into 
the fast dynamics, we require 

B 2 GxC 2 = 0 (5.5) 

The following lemma provides an easily enforced constraint for satisfying 
(5.5). This lemma and Lemmas 5.2 and 5.3 are proven in the Appendix E. 
Lemma 5.1 : Condition (5.5) holds iff 

B 2 G?C 2 =0 (5.6) 

where 

G° = (I + G 1 D 0 )“1Gi (5.7) 

Moreover, if (5.6) holds, then the inverse in (5.7) exists and is 
given by 

(I + GiDo)" 1 = (I-GxDq) (5.8) 

The slow susbsystem design thus consists of satisfying (5.1) and (5.6), 
where G° = G° i n (5.1). Once a satisfactory G° is obtained, Gj is calcu- 
lated using 
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(5.9) 


Gi = Gi<I - D 0 Gi)"l - G°(I + D 0 G°) 

The second equality of (5.9) can easily be verified from (5.6) and the 
form of D 0 in (3.7) Also, note from (5.8) and the form of D 0 that, if one 
only exploits rank deficiency in the fast subsystem input matrix; that 
is, if one insists that 

B 2 G° =< 0 (5.10) 

then G° » Gj, so that Gj may be directly designed to stabilize Aq-BqGiCo 
subject to the control spillover constraint (5.10). 

Now, suppose that the fast dynamics require improvement. In this 
case, G 2 is designed to stabilize the fast dynamics without spilling over 
into the slow dynamics. The design criteria are (5.2) and 

B 0 [I+(Gi+G 2 )D 0 ]-l(G 1 +G 2 )C 0 = B 0 GiC 0 (5.11) 

where the spillover condition (5.11) is obtained from (3.9), (5.1) and 
(5.4). One immediately notes that, if D 0 = 0, (5.11) collapses to a form 
which mirrors the slow subsystem GSS condition: 

B 0 G 2 C 0 = 0 (5.12) 

The following Lemma provides a necessary and sufficient condition on G 2 
for satisfaction of (5.11) 

Lemma 5.2 : Condition (5.11) holds iff 

B 0 (I-G 1 D 0 )G 2 (I-D 0 G 1 )C 0 = 0 (5.13) 

Despite the fact that (5.13) is dependent on Gj, the slow subsystem gain 
has no effect on the fast subsystem dynamics: 

Lemma 5.3 : Given that G^ satisfies (5.5) and G 2 satisfies (5.13), 

B G C is not a function of Gi. 

2 2 2 1 

Lemma 5.3 implies that no flexibility is lost by adopting a two-step 
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design procedure in which Gj is treated as a constant during the design 
of G2 satisfying (5.13). The set of admissible stabilizing G2 is limited 
only by ker{B 0 ) and ker{C 0 T ). On the basis of the preceding development, 
the following theorem is stated: 

Theorem 5.1 : Let G° be an asymptotically stabilizing feedback gain 

for the reduced system {A 0 ,B 0 ,C 0 } which satisfies the GSS constraint 
(5.2). Let G2 be an asymptotically stabilizing feedback gain for 
the fast subsystem {A22 >82,02) satisfying the GSS constraint 
(5.13). Then, 

G - G°(I + DqGx 0 ) + G 2 (5.14) 

stabilizes the full-order system (3. 1-3.4) for sufficiently small e. 
Moreover, the closed-loop spectrum will be given by (5.3). 

An easily implemented approach to enforcing the GSS conditions (5.5) and 
(5.13) is developed in the next section. 

5.2 LQ Design Procedure 

In this section, LQ optimal control theory is applied to the problem 
of determining G that stabilizes the matrix 

A = A - BGC (5.15) 

subject to the constraint 

MGP - 0 (5.16) 

which corresponds to the general form of the conditions stated in the 
theorem. Under the assumption that a solution exists, this is done by 
defining the performance index 

Jo = E {/qX T Qx + u t Ru dt) + VHMGPH 2 (5.17) 

x o 

for the dynamics 

x = Ax + Bu x(0) = x Q (5.18) 
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u = -GCx (5.19) 

In (5.17), Q = r T r such that {r,A} is detectable and R > 0. The notation 


E Xo (.} denotes expectation with respect to the random initial state Xg 
where, for simplicity, it is assumed that Xg is uniformly distributed on 

T 

the unit sphere, so that E{x 0 x 0 } = I. The notation II. ll denotes the inner 
product matrix norm 

OWN 2 = tr{W T W} (5.20) 

and v > 0 is chosen sufficiently large that HMGPH -► 0. Following [5], 
the Lagrangian is written: 

3?(G,K,L) = tr{K} + tr (S(G,K)L t ) + vUMGPH 2 (5.21) 

S(G,K) = A T K + KA + Q + C t G t RGC =0 (5.22) 

The first-order necessary conditions for optimality are: 

a < 0 zg = o as?3K = o as?/3L| = o (5.23) 

* * * 

where the *'s indicate that the gradients are evaluated at the optimal 
values of G, K and L. The * notation is henceforth suppressed, since the 
gradients are assumed evaluated at their optimal values unless specified 
otherwise. Expanding the gradients in (5.23), we have: 


-B t KLC t + RGCLC t + vM t MGPP t = 0 

(5.24) 

AL + LA t +1=0 

(5.25) 

S(G,K) = 0 

(5.26) 


These necessary conditions can be solved by using the algorithm described 
below. This algorithm satisfies the sufficient conditions for numerical 
convergence given in Section 2, is simple to implement, and has 
demonstrated a "fast" rate of convergence in practice. 
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0. Choose any G rendering A Hurwitzian. Set i =* 0. Set G » GCC* 

1. Solve (5.25,5.26) for L 1 , K* 

2. On the basis of (5.24), evaluate 

LG 1 » R"l(B T K 1 L 1 C T -vM T MG 1 PP T ](CL i C T ) + -G 1 (5.27) 

3. Set 

Gl i+1 » g 1 + oAG 1 (5.28) 

where a e (0,11 is chosen to ensure that 

J i+1 < Ji - tr{K*} + vnMGipn (5.29) 

Note: In (5.27) and step 0, (,) + denotes the pseudoinverse. In the 

case where p(C) = p, CC*" ■ I and (CLC^) + = (CLC^) - !; however, 
this is not generally the case. Using the characteristics of 
the pseudo-inverse in Appendix A, it can be shown that the 
columns of the transposed incremental gain (AG i ) T will always 
lie wholly in im{C^}. Because of this fact, the algorithm 
satisfies the requirements in Theorem 2.1 for convergence. 

5.3 Numerical Example 

The design procedure of Section 5.2 is demonstrated on a model of a 
large flexible space structure. Data for this system came from [32]. 


All = 


0 10 0 

-(.42) 2 000 

0 0 0 1 

. 0 0 -(.43) 2 0 - 


Aj2 = 0 
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1 


0 


0 


A 22 /<? 



Ci =* 


c 2 = 


1 

/N 

to 

• 

J — * 

' w ' 

to 

0 

0 

0 



0 

0 

0 

1 



0 

0 - 

( 2 . 2) 2 

0 


- 

0 

0 

0 


o ■ 

- 

.92 

- 1.4 

.92 

- 

L .4 


0 

0 

0 


0 


.65 

1.6 

.65 

- 

L .6 


0 

0 

0 


0 

1 

.4 

- 1.0 

1.4 

1 

.0 


0 

0 

0 


0 

- 2 

.05 

-.80 

- 2.0 


.80 _ 


"o 

- 1.8 

0 


1 . 3 " 


0 

- 2.7 

0 


3.2 


0 

1.8 

0 


1.3 


_0 

- 2.7 

0 

• 

- 3.2 


'o 

2.9 

0 


4 . l " 


0 

- 2.1 

0 


- 1.6 


0 

2.9 

0 

- 

- 4.1 


0 

2.1 

0 

• 

- 1.6 


A 2 1 - 0 


In this system, the third and fourth modes are approximately five times 
faster than the first and second modes. When describing the system in 
the form (1,2), one would naturally choose e = 1/5. In the reduced order 
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model D 0 = 0. In the absence of control feedthrough the GSS constraint 
for the fast subsystem collapse to the form (5.12). 

The penalty weights employed in the slow and fast subsystem designs 

were: 

Q 0 = diag[0, 0.065, 0, 0.065] Rq = I 

Q 2 - diag[0, 1.3, 0., 1.0] R 2 - I 

Figure 3 shows the upper half plane closed-loop eigenvalues due to G 
formed from optimal subsystem designs without GSS (v 0 = v 2 = 0). The 
Figure also displays the intended closed-loop eigenvalue locations for 
the slow and fast subsystems. Note that the gain spillover distorts the 
response of the full-order system, tending to destabilize two of the 
modes. Figures 4 and 5 show the variation of integral quadratic 
performance and spillover penalty for the slow and fast subsystems, 
respectively. Figure 6 shows the upper half-plane closed-loop 
eigenvalues for the gain resulting from choosing v Q = 10 and v 2 = .0001 
for design values. The degradation in integral quadratic cost due to the 
constraint of GSS for the slow subsystem was less than 1.8%. The degra- 
dation in the fast subsystem was negligible. 
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FIGURE 3 


□ Subsystem Eigenvalues 
A Full System Eigenvalues 

CLOSED-LOOP EIGENVALUES WITHOUT 


SPILLOVER SUPPRESSION 












FIGURE 6 


□ Subsystem Eigenvalues 
A Full System Eigenvalues 
♦ Open-Loop Eigenvalues 

CLOSED-LOOP EIGENVALUES WITH SPILLOVER 


SUPPRESSION. 



SECTION 6 


TWO TIME SCALE DYNAMIC COMPENSATION 

In this section, the static gain theory developed in Sections 3-5 is 
extended to the case of output feedback regulators which include dynamic 
elements in the feedback structure. The approach taken here is a 
straightforward adaptation of the standard approach used in dynamic 
compensation problems which employ state variable methods [6,7,33,34]: 
Slow and fast compensator states are adjoined to the slow and fast plant 
states so that, in essence, the compensator becomes a subsystem of the 
plant with full state output. The important feature here is that the 
compensator has the same two time scale character as the plant, and is 
decomposed into two subsystems with it. In [36] an analog of the two 
time scale fixed-order compensator is examined - the singularly perturbed 
Kalman filter. There, it was shown that, in addition to a complete 
separation of the slow and fast subsystem control designs, the filter 
dynamics also separate. This results in separate filters for each 
subsystem. It will now be seen that, for the fixed order case, "almost" 
separate compensators may be designed for each subsystem - separate in 
the sense that, although they both use the same static gain feedback 
matrix, they do not share any dynamic elements. 

The control law takes the form: 


u c = -Gy - Hizi - H2Z2 


(6.1) 

Z 1 = -Pnzi - Pi2Z2 “ N iy 

z\ e R nZ * 

(6.2) 

eZ2 = ~P21 Z 1 “ ?22 z 2 " N 2y 

Z2 e R nZl 

(6.3) 


where y is the system output defined in (3.3). In order to apply the 
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and compensator dynamics 


( 6 . 10 ) 



( 6 . 11 ) 


G 

% 

h 2 

N1 

Pll 

Pl2 

. N 2 

P21 

p 22 + 


G c = 


Note that by expressing the compensator in this manner, one can directly 
apply the static gain theory of Sections 2-5. Decoupling the closed- 
loop dynamics of (6.4-6.11) by a transformation analogous to (3.13) 
results in 


£c 33 t (Wq^HoGcSo) + 0(e)] 5c 
en c 3 t(W22” n 2 G c s 2) + 0 (e) ln c 

where 
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H? 

H2 ' 



N? 

Pll 

Pl2 
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P21 

P22. 

The relation 

analogous 

to (3.9) 

is 

G c = 

(I + 

G c Yo> 

-1 G C 




Do 

0 

0 

* - 


0 

0 

0 



0 

0 

-I 


( 6 . 12 ) 

(6.13) 


C 0 0 

0 I 
0 0 


(6.14) 


(6.15) 


(6.16) 


(6.17) 
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At e = 0, the closed-loop matrices (6.12,6.13) are 


w 0 “ n 0 G c s 0 — 


A<j “ B 0 G 0 C 0 

-NlC 0 


-B 0 Hl 

-Pll 


(6.18) 


w 22 “ n 2 G c s 2 


A22 “ B 2 GC 2 


-b 2 h 2 


(6.19) 


L “ n 2 c 2 1 ” p 22 J 

Note that in (6.18) and (6.19), the closed-loop subsystem dynamics do not 
involve any of the cross-coupling terms between the slow and fast compen- 
sator states. This system structure is displayed in Figure 8. An 
examination of this Figure suggests a simplified design problem: Given 

the input and output matrices 



-B 0 O' 


O 

O 

O 

no - 


» S 0 - 



0 I_ 


.0 I - 



l 

00 

N> 

O 

1 


'c 2 0 " 

n 2 - 


s 2 = 



_° I . 


_0 I _ 


design 


to stabilize W 0 - 
G c 


G° 

H? 


. N ° 

p n_ 


IIoG c So, 

and 

design 

"g 

h 2 ■ 


n 2 

p 22 



( 6 . 21 ) 


( 6 . 22 ) 


(6.23) 


(6.24) 


to stabilize W2 2 - II 2 G C S 2 , where G and G° are linked by a constraint. 
After the designs have been completed, reconstruct the implementation 
compensator matrix G c in some manner from the elements of G° and G c . 
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It turns out that if the rank conditions (3.10) and 

p{?22) = nz 2 (6.25) 

hold, then the design problem can be decomposed in this manner, without 
imposing any additional constraint on the final solution. From Lemma 
3.2, the inverse in (6.16) exists as long as the fast subsystem plant/ 
compensator dynamics are stabilized. Expanding (6.16) as 

G? - G c - G^Gl - 0 (6.26) 

and partitioning, using (6.11) ,(6.15) and (6.17) gives a system of nine 

matrix equations. Among these are the following six, which can be used 

to derive the remaining compensator blocks in (6. 1-6. 3): 

G° - G + GD 0 G° - H 2 N 2 = 0 (6.27) 

N° - N x + NPoG 0 - P 12 N 2 = 0 (6.28) 

-N 2 + N 2 D 0 G° - P 22 N 2 =0 (6.29) 

H° - H X + GD 0 H? - H 2 P 21 =0 (6.30) 

P?1 " Pll + NiD 0 H? - P 12 P^j =0 (6.31) 

- P 21 + N 2 D q Hi - P 22 P 21 =0 (6.32) 

From (6.27) and (6.29), 

G = G°(I - D 0 G 0 ) _1 - H 2 P 22 N 2 (6.33) 

Combining (6.28) and (6.29) gives 

Nj, - N°(I - D 0 G°) _1 - Pl2P22 N 2 (6.34) 

Expressions for Hj , Pjj and P 2 j follow directly from (6.30-6.32): 

Hi = (I + GD 0 )H° - H 2 P 21 (6.35) 

P 11 = P 11 + N l D o H l “ p 12 p 21 (6.36) 

P 21 - N 2 D 0 H° - P 22 P^ (6.37) 
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This formulation raises the following questions: 

What is the significance of the off-diagonal compensator blocks 
{Pl2,P2i) and {P?2»P2lH It Is evident from Figure 7 that these elements 
do not affect closed-loop stability, but what about shaping the system 
eigenvectors? The constraint (6.26) gives one the option of setting 
either P 12 or P?2 to zero and of setting either P 21 or P 21 to zero. 
Zeroing {Pi2»P2l) seems a reasonable simplification of the compensator 
dynamics, if its slow and fast states are Implemented by separate 
devices, but this hardly parallels the decomposition seen in the optimal 
stochastic regulator case [36]. Since they do represent extra degrees of 
freedom in the design without contributing to dimensionality, zeroing of 
these elements may be a waste of potential. 
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SECTION 7 


CONCLUSIONS 

This research effort has been directed toward easing the difficul- 
ties encountered in the calculation of quadratic optimal output feedback 
gains for linear systems - in particular, linear systems with slow and 
fast modes. The results of this effort are summarized below. 

A fast, simple convergent sequential numerical algorithm has been 
developed for calculating optimal output feedback gains which minimize a 
class of performance indices which includes the standard LQ case. In 
order to demonstrate the theory, a performance index penalizing the mag- 
nitude of individual gain elements in an output feedback gain matrix was 
proposed and demonstrated. Employment of this form of performance index 
in design allows severing of individual feedback loops by zeroing 
selected gain elements without sacrificing quadratic optimality in the 
remaining loops. This dramatically enhances the flexibility of optimal 
multivariable output feedback design. 

It has been shown that two time scale approximation in the output 
feedback design problem is always well-posed, as long as the fast dynam- 
ics are asymptotically stable in the closed loop and as long as there is 
sufficient time scale separation between the slow and fast dynamics. 

A two time scale approximation to the LQ optimal output feedback 
problem has been derived. When implemented, this approximation provides 
at least a first-order approximation to optimal quadratic performance. 

In addition, if the measurement set for the slow subsystem is nonredun- 
dant, the performance is a second-order approximation. A computational 
algorithm for calculating these approximate gains was described and 
demonstrated. The algorithm is related to and shares the convergence 
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properties of the general optimal output feedback algorithm previously 
mentioned. 

The two time scale approximation described in the previous paragraph 
leads to a one-step design procedure. The gain design must balance the 
performance of the slow and fast dynamics simultaneously. In order to 
obtain a simpler approach to design, necessary and sufficient conditions 
were derived for decoupling the slow and fast subsystem designs through 
mutual suppression of control and observation spillover, A simplified LQ 
design procedure was developed and demonstrated. 

Finally, extension of the two time scale static gain theory to the 
case of fixed order dynamic compensation was briefly examined. Several 
questions remain to be resolved, leading to the conclusion that a further 
investigation of this area should be highly rewarding. 
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APPENDIX A 


USEFUL MATRIX PROPERTIES 

From [37], the pseudoinverse of A is defined as X satisfying 


AXA = 

A 

(A. 1) 

XAX « 

X 

(A. 2) 

(AX)* = 

AX 

(A. 3) 

<XA)* = 

XA 

(A. 4) 


where (.)* is the complex conjugate transpose of (.). Such an X always 
exists and is unique. If A e<5P mxn with m < n and p{A} = m then AX ■ I,,,. 
In this case the pseudoinverse X is a right inverse. 

A useful identity for matrix inverses can be found in [38]. If A, C 
and (A + BCD) are nonsingular 

(A + BCD) -1 = A -1 - A^BCC -1 + DA -1 B) -1 DA -1 (A. 5) 

An important eigenvalue property for Kronecker products is supplied 
supplied by [39]: 

Lemma : Given N e^? sxs with eigenvalues (Ai,..., X s } and M e^ txt 

with eigenvalues {pi,. . . then the eigenvalues of the 
Kronecker product N©M e^? st> <st are 

ON ©M = { Ai ijj : i=l , . . . ,s j j a l,...,t] (A. 6) 
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APPENDIX B 


PROOF OF THEOREM 2.1 

Before proving the theorem, several preliminary results are 
established. 

Lemma B.l : For L satisfying (13) where (1,11) hold, there exists a 

$ such that 

(CLC 1 )” 1 - $ +T $ + (B.l) 

= I p (B.2) 

where $ + is the right inverse of $, and Ip is the p-dimensional 
identity matrix. 

Proof : 


(B.3) 

(B.4) 


Since L > 0 for G e # , it can be represented as 
L = Ll/2 L l/2 

where L*/2 > o, so that 

$ = CLl/2 

has full rank p, and therefore,* there exists a right inverse of $ + . 

In order to prove (B.l), first note that 

CLC t = <f$ T (B.5) 

Premultiplying by $ + gives 

$ + CLC t = (B.6) 

Using property (A.l) for pseudoinverses, 

$T $ + T $ T = $T (B.7) 

and property (A. 4) gives 

4,+$$T = $ T (B.8) 

Premultiplying (B.8) by and using (B.2) results in: 

$+ T <5 + CLC t - ($$ + ) T = I D (B.9) 
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T 

which demonstrates that $ + $ + is a left inverse of CLC^. Finally, (B.l) 
is true by the uniqueness of the inverse of a nonsingular matrix. 

Lemma B.2 : Let > ?2 > 0, W > 0 be Hermitian matrices. Then 

tr{PxW} > tr{P 2 W} > 0 (B.10) 

The proof is found in [13]. The next lemma establishes the exis- 
tence of some bounded G* e <& which minimizes the performance index. 

Lemma B.3 : Given the assumptions of the theorem, there exists a 

G* e such that 

J(G*) < J(G) for all G e» (B. 11) 

Proof : 

In the proof, lower case Roman numerals refer to the conditions of 
the theorem. S5 is an open region in g mx P since the characteristic poly- 

A> 

nomial of A is a continuous function of G. Because J takes the form 
(2.4), it is easy to see that J is^l On'S, given (iv). Also J(G) has a 
greatest lower bound, say n, over&. This can be seen by noting that, 
because of continuity, finite values of G e give rise to finite values 
of J. If y(G) becomes negatively unbounded for unbounded G, expressing J 
as 

J - tr{K}(l + y(G)/tr{K}) (B.12) 

and applying (v), shows that J + as UGH + <*> for all y(G) satisfying 
(iv,v). Suppose we specify a G 0 e By the continuity of J(G) , the 
subset of defined by the inverse mapping of the closed interval bounded 
by n and J(G 0 ) , 

£ = {G:n < J(G) < J(G 0 ) } (B. 13) 

is closed. 
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If G is also bounded, the solution G* e ® is guaranteed to exist. 

To prove the boundedness of®, it is sufficient, from (v), to show that 
unbounded values of G give rise to infinite integral quadratic cost and, 
hence, cannot belong to®. Since K satisfies the Lyapunov equation 
( 2 . 6 ), 

2 BK(A-BGC) II = DCH-C T G T RGCll (B.14) 

Using the Cauchy-Schwartz inequality 

2hkj ha-bgcii > hq+c t g t rgcii > n c t g t rgc n (b.15) 

or 

hkh > iic t g t rgch/2ha-bgch (b.16) 

We will now specialize our argument to the inner product matrix norm 

in = (tr{rr T }) 1/2 (B.17) 

since it relates in a direct way to the integral quadratic cost: 

IK II = (tr {K 2 }) (B. 18) 

It is well known that, for r > 0 and any x of compatible dimension, 

x T rx > (x T x)X ra i n (r) (B.19) 

where \ni n (r) is the smallest eigenvalue of r. Suppose that there is 
some sequence {G^ i > 0: G^ e®} such that some elements in the j 1 -* 1 

column of G become unbounded. By (B.17) and (B.19), 

0G t RG|| > (gjgj)A m i n (R) (B.20) 

which, since R > 0, implies that elements in a column of R^/^q become 
unbounded, where R*/2 > 0 is defined by 

R = Ri/ 2 Rl/2 (B. 21) 

Next, recall that p(C) = p implies 

o 

CCT > o (B.22) 
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Suppose now, that elements In the k^ 1 column of G^rI/Z become unbounded. 
By (B.17), (B.19) and (B.22) we find that 

1IR 1 /2GCB «° (B.23) 

Since, with (B.17,B.18), (B.16) can be expressed 

(trff2})l/2 > (B.24) 

the integral quadratic cost becomes unbounded, in contradiction to 
(B.12), completing the proof. 

Proof of Theorem : 

From (2.12), the gradient of the Lagrangian with respect to G is 
given by 

<gQ = RGCLC t - BTKLC T + y G (G) (B.25) 

The inner product of the search direction (2.16) with the gradient (B.23) 
is 

S(G) s tr {SE qAGT} (B.26) 

If it can be shown that 

6(G) < 0 if G e » and SBq * 0 (B.27) 

then the proof follows almost immediately. Assume that (B.27) is true. 
The continuity of the gradient implies that, for each iteration, there 
exists some a* sufficiently small that (2.18) is satisfied for 
0 < a < a*. Under this circumstance, by the definition of G in (34), 

Gj e® implies that G^+i e^. Moreover, the sequence {J(Gi):i ■ 0,1,...} 
with G^ defined by (2.17,2.18) is convergent, since it is monotonic and 
bounded. Recall from Lemma 3 that G is closed and bounded. This and 
the continuity of J imply that the sequence {Gj:i = 0,1,...} is 
convergent. 
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We will now demonstrate (B.29). Expanded, (B.26) is expressed 
0(G) = tr{[RGCLCT-BTKLC T +Y G (G)][(CLC T )“ 1 (CLKB-YG(G))-G T R]R" 1 } (B.28) 
Substituting for CLC^ and (CLC^)”* using Lemma B.l, 

0(G) ■ tr { [ RG $ $ T -B T KL 1 / 2 $ T + y g ( G ) ] [ $ +T $ + $L 1 / 2 KB- <f +T <f + y G ( G ) -G T R ] R“ 1 } (B.29) 
Expanding, and then factoring (B.28) results in 

0(G) = -tr {PP^R“1} (B.30) 

P = B t KL 1 / 2 ($ + $) t -RG$-y g (G)$ +T (B.31) 

By Lemma B.2, R“* will not affect the sign of 0(G), which implies that 
0 < 0, except at a stationary point in J; thus the sequence must converge 
to a stationary point. 
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APPENDIX C 


PROOF OF LEMMAS IN SECTION 3 


C.l Proof of Lemma 3.1 

In the proof, matrix calculus operations and Kronecker algebraic 
identities are employed, for which [38] is an excellent reference. 

Define the function vec (.): R mx P R m P by 

vec(An, xp ) = 

From (3.9), it follows that 

F(Gi ,G°) = vec G° - vec G + vec (GD 0 G°) (C.l) 

« vec G° - [ (Ip-D 0 G°) T I m ] vec G - 0 (C.2) 

where 1^ denotes the k-dimensional Identity matrix. From (A. 6), the 
Jacobian 

VSP . ’&l - - [I mp0 ((I-D 0 GO)T 0 I m )] (C.3) 

9vec G 

is nonsingular iff 

p(l-D 0 G°) = p (C.4) 

Assume that this is the case. By the implicit function theorem, (C.4) 



implies that G is uniquely defined as a continuous function of G° in an 
open region around any fixed G° satisfying (C.4); that is, there exists a 
continuous function <j>(G°) such that 

vec G = <|>(G 0 ) (C.5) 
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This lets us rewrite (C.3), using the chain rule: 


t 8F(G,G°) j 

9vec T G 


4>(G°) 


3F(<|)(G 0 ) > G0) . 8 4> ( G°) 

m L rp J 

3vec G° 3vec G° 


(C.7) 


G° = G° 


Since the LHS of (C.7) has full rank, this implies that 


det 


^ 3F(G,G° ) j 
3vec T G 


* 0 


G 3 <J>( G°) 
G 0 - G° 


(G.8) 


where 

I - F - ( - G ^ 0 ) 1 = Ump ®Ip ®(I+GD 0 ) (C.9) 

3vec G 

which implies that (3.10) holds if (C.4) does. The converse is proven by 
reversing the above arguments. 

C.2 Proof of Lemma 3.2 
Consider the matrix 

= I + GC 2 (A 2 2 ~ B 2 GC 2 ) -1 B 2 (C.10) 

where the inverse exists by assumption. Suppose that p{B 2 }=r<m. It 
can be immediately seen from x satisfying 

[(X - 1)1 - GC 2 (A 22 - B 2 GC 2 )~ 1 B 2 ]x =0 x * 0 (C.ll) 

that has m-r unity eigenvalues, since dim ker{B 2 } = m-r. Now, from 
property (A.l) for pseudoinverses, 

B 2 B 2 [I+GC 2 (A 22 -B 2 GC 2 ) _1 B 2 ]B 2 B 2 =» B 2 [I+B 2 GC 2 (A 22 -B 2 GC 2 ) -1 ]B 2 (C.12) 

= B 2 [A 22 (A 22 -B 2 GC 2 ) _1 ]B 2 (C.13) 

The remaining eigenvalues of i[> are obtained from 

B 2 [XI - A 22 (A 22 - B 2 GC 2 ) _1 ]B 2 X =0 x e im{B 2 } (C.14) 
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Because of the nonsingularity of ^ 22^22 ” B 2 G ^2^”^> 'J' is nonsingular. 
Using the inverse identity (A. 5) and recalling the form of D 0 from (3.7), 
one obtains 

ip” 1 • I “ GC 2 A22B 2 - I + GD 0 (C. 15) 

The converse is proven by assuming that (I + GD 0 ) is invertible, and 
reversing the logic. 
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APPENDIX D 


PROOF OF THEOREM 4.1 

The proof of the theorem requires several preliminary results. 

Lemma D.l : Given that G stabilizes the closed-loop system 

(3. 1-3. 4), then 

Ki - l e 1 ^ K 3 » l e 1 ^ 1 * (D.l) 

1=0 1=0 

proof : 

This result Is well known. From (4.7) and (4.9) at e = 0, Kj and K 3 
satisfy 

Fi(K lt e) = [(A 0 -B 0 G°C 0 )T®i nl +i nl ©(A 0 -B 0 G°C 0 ) T ]vec Ki+vec Qi = 0 (D.2) 

F3<K3,e) = I(A 2 2-B2GC 2 ) T ®I n 2+In2®( A 22” B 2GC2) T ]vec K 3 +vec Q 3 = 0 (D.3) 
where © denotes the Kronecker product and vec (.) is defined in Appendix 
C. Since Aq - B 0 G°C 0 and A 22 “ B 2 GC 2 are both nonsingular, It is easy to 
verify that 

det[ 3F]/3vecT 'Kj] * 0 det[3F 3 /9vec T K 3 ] # 0 (D.4) 

and that these Jacobians are continuous in "Kj_ and K 3 , respectively. By 
the Implicit function theorem, this implies that "Kj_ and K 3 are analytic 
functions of e at e = 0 and, hence, representable by power series expan- 
sions. 

Lemma D.2 : If J°(G) < J(G) then 

3 J °/ DC | G = g - 0 (D.5) 

proof : 

It was shown in the proof of Lemma B.3 that, for p{C} = p and R > 0, 
the control cost in (4.1) for the full-order system becomes unbounded for 
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UGH -*■ ». This implies that G is bounded. Further, since the characteristic 
polynomials of A q - B Q G°C o and A^ - BgGCg are continuous functions of G° and 
G, the set of asymptotically stabilizing gains is open, implying that 5 is in 
its interior. This implies that J°(G) is a stationary point in G, so that 
(D.5) holds. 

Lemma D.3: If AG = 0(e) , 

G°(G + AG) = G°(G) + 0(e) (D.6) 

where G°(G) is defined by (3.9). 

proof : 

Since the set {G: p(I + GD Q ) = m} is open, there exists some e* such 
that p(I + GD q +eAGD Q ) = m for 0 < e < e* and finite AG. From (3.9) and A. 5, 

G°(G + eAG) = [(I + GD q ) + eAG] _1 (G +eAG) 

- = (I + GD o ) _1 [I + 0(e)] [(G + 0(e)] 

= G°(G) + 0(e) (D.7) 

proof of Theorem : 

By Lemma D.l, J can be expanded to first order about e = 0: 


J = tr{R (0) } + etrfRj 1 )} + etr{R^ 0) ) + 0(e 2 ) (D.8) 

= J° + etr{R^+ 0(e 2 )} (0.9) 

Now, define 

6J = J(G*) = J(G) < 0 (D.10) 

6J° = J°(G*) - °J(G) > 0 (D. 11) 

6k[ 1J = (G*) - k[ 1J (G) (D.12) 
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Use (D.7 - D.10) to form 

<$J = 6J° + etr{6K[ 1) } + 0 (e 2 ) < 0 (D.13) 

Since 6J° > 0, it follows that 

6J° = 0(e) (D.14) 

In turn, since C Q has full rank, (D.14) and Lemma 3.1 imply that 

II G* - Gil = 0(e) (D.15) 

Which, with Lemma D.2 implies that 

6J° = 0(e 2 ) (D.16) 


-f 11 2 

Lemma 3.1 and (D.15) also imply that etr{6K^ '} is 0(e ); hence it follows 
from (D.9) that SJ is 0(e 2 ). 
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APPENDIX E 


PROOFS OF LEMMAS IN SECTION 5 


Proof of Lemma 5.1 : Given that 

®2®1^2 ®* 0 (E.l) 

and recalling that 

D 0 » -02^22^2 (E.2) 

one easily verifies that 

(I + GPo)* 1 » (I - G^o) (E.3) 

Now, using (23), (E.3) and (E.l), 

B 2 GiC2 - B 2 (I - GiD 0 )GiC 2 = 0 (E.4) 

The converse is shown by using (5.9): 

B 2 GiC 2 - B 2 gJ(I + D 0 Gf)C 2 (E.5) 


By (5.6), the EHS of (E.5) is zero, completing the proof. 

Proof of Lemma 5.2: From Lemma 3.2, given that A 22 is invertible, 


(I + G 2 D q ) is invertible for all G 2 stabilizing the fast dynamics. 
Employing (A. 5), 

(I + D 0 G 2 ) _1 = I - D 0 (I + G 2 D o r 1 G 2 (E.6) 

so that (I + D 0 G2)”1 exists. Applying the same identity to the inverse 
in the LHS of (5.11), along with (E.1-E.3), 

[I+(G 1 +G2)D 0 ]-1=(I-G 1 D 0 )[I-G2(I+D 0 G 2 )" 1 D 0 ] (E.7) 

Thus, the LHS of (5*11) can be expressed 

B 0 [I+(G 1 -H;2)D 0 ]- 1 (G 1 +G2)C 0 =B 0 (I-G 1 D 0 )[I-G2(I+D 0 G2) _1 D 0 ](G 1 +G2)C 0 (E.8) 

so that (5.11) becomes 

B 0 (l - G 1 D 0 )G 2 [I - (I + D 0 G 2 ) -1 D 0 (G! + G 2 )]C 0 = 0 (E.9) 

After some algebra, (E.9) yields 

B 0 (I-G 1 D 0 )G 2 (I+D 0 G 2 )" 1 (I-D 0 G 1 )C 0 = 0 (E. 10) 
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It is easy to verify that 

G 2 (I + D 0 G 2 ) _1 3 (I + G 2 D 0 )-lG 2 (E.ll) 

This implies that 

ker {G 2 (I + D 0 G 2 )” 1 } - ker{G 2 } (E.12) 

which implies that (E.10) holds iff (5.13) is true. 

Proof of Lemma 5.3 : A matrix N satisfying 

MNP 3 0 (E. 13) 

can be written 

N - IV + N p (E. 14) 

where 

MN m 3 0 N p P “ 0 (E. 15) 

In (5.13), 

M 3 B 0 (I - GiD 0 ) (E. 16) 

P 3 (I - D 0 G 1 )C 0 (E.17) 

so that 

G 2 - (I + G 1 D 0 )N B(J + N Co (l + D 0 G!) (E. 18) 

where (I + D 0 Gi) 3 (I - D 0 Gi)"l. Because of (E.1,E.2), when G 2 from 
(E.18) is substituted into B 2 G 2 C 2 , G^ cancels so that 

B 2 G 2 C 2 3 B 2 (N Bq + N Cq )G 2 (E. 19) 
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